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(54) Multimedia call signalling system and method 



(57) A system and method for performing call sig- 
nalling for multimedia call setups. A user equipped with 
calling terminals of various types may initiate a call from 
any of these terminals, and the call is intercepted and 
handled by the system. A calling agent looks up an E- 
mail address for the called party, and sends a setup re- 
quest E-mail to a called agent associated with the called 
party. The called agent determines the current terminal 



that the callee is using, and together with the calling 
agent a call medium and other parameters are estab- 
lished. Then a connection is made between a calling ter- 
minal and the current terminal. This provides a generic 
signalling system for a callee using a wireline terminal, 
wireless terminal, or H.323 terminal to be connected to 
a called terminal also being any one of these or other 
types. 
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Description 

Field of the Invention 

5 [0001] The invention relates to a system and method tor multimedia call signalling. 
Background of the Invention 

[0002] There are many known call setup methods for use in setting up calls within the PSTN (public switched tele- 

10 phone network) though new methods are still evolving. 

[0003] Data telephony, over a data network such as the Internet for example, will likely soon start to carry a significant 
amount of multimedia traffic, and has its own call setup methods for establishing calls over the relevant data network. 
Various different data networks exist including the Internet, wireline networks, cellular networks, and PCS (personal 
communications systems) networks for example. In addition, calls other than voice calls of course are establishable 

is over such data networks. These include FAX calls, video calls, T.120 conference calls etc. 

[0004] When a user wants to make a regular phone call, the user's phone informs a switch via a sequence of electrical 
signals or a message. Software in the switch will engage a process to find out where the called phone is located by 
performing an address translation. The address translation will return the information related to which trunk and which 
protocol should be used to signal a remote CO (captive office) which will ring the called phone. 

20 [0005] In the case of an H.323 terminal, a call setup request is sent in a message to a component called the gate- 
keeper to perform address translation. The address passed to the gatekeeper can be a symbolic name or an Internet 
address. In the current H.323 implementation, the gatekeeper will use the H.245 and H.225 protocols to complete the 
call. 

[0006] It would be desirable to be able to place calls of various types from a PSTN based terminal for example for 
2S connection to a data network based terminal, and call setup methods must be established for this. Existing solutions 
have focused on a few particular instances of the problem such as Internet to PSTN voice calls. 

[0007] These existing solutions provide a single solution for one or two media, but do not provide an approach to 
solving the problem in a general fashion. 

[0008] One of the technical challenges in solving this problem is the complexity and diversity of the types of call 
so processing equipment, call transmission media and protocols involved all of which are based on various technologies. 

Summary of the Invention 

[0009] It is an object of the invention to obviate or mitigate one or more of the above identified disadvantages. 

35 [0010] According to a broad aspect, the invention provides a multimedia call signalling end system comprising a 
calling agent for connection to a network for coordinating the establishment of a connection between a calling terminal 
served by the calling agent and another terminal, the calling agent comprising: a) means for receiving a call setup 
request from the calling terminal including a user identifier; b) means for looking up an E-mail address corresponding 
with the user identifier; c) means for generating a call setup E-mail with said E-mail address and mailing it to said 

40 address; and d) first means for coordinating the establishment of an outgoing connection between the calling terminal 
and the another terminal. 

[0011] A first element empowering this invention is based on an encapsulation principle. Because different telephony 
and communication networks use different signalling protocols, to make the signalling protocol independent the call 
setup requests are encapsulated in a common format. This invention devises a scheme to encapsulate an outgoing 
45 call request with ail associated attributes preferably using the MIME (Multipurpose Internet Mail Extension) principle 
from Internet Engineering Task Force (IETF). 

[0012] A second element empowering this invention is the use of an E-mail address or an electronic address for the 
user. Once used, this conceals the discrepancies or deficiencies of the terminals to be connected and broadens the 
choice of the medium which can be used for the connection. 
so [001 3] A third preferred element empowering this invention is the use of MIME application typing so that an electronic 
message server can associate any required processing with various components in the message. As a result, this 
invention provides a generic mechanism to support multi-media multichannel and multi-device communication call 
setup. 

[0014] The broad application domain of the signalling protocol allows it to be applied to PSTN, Internet and cable 
55 networks and to other network types as it becomes appropriate. It also enables the establishment of multi-media phone 
calls that support multiple terminals and connections. 

[0015] Advantageously, the system provided by some embodiments of the invention is applicable to existing teleph- 
ony equipment without the need for any change to customer equipment. 
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Brief Description of the Drawings 

[0016] Preferred embodiments of the invention will now be described with reference to the attached drawings in 



Figure 1 is a logical block diagram of a terminal as it would be viewed by a multimedia call signalling system 
according to an embodiment of the invention; 

Figure 2 is an abstract model of a multimedia call signalling system according to an embodiment of the invention- 
Figure 3 is an example call setup walkthrough; 

Figure 4 is an abstract model of the system of Figure 2 including a remote configuration; 

Figures 5a - 5d are state diagrams for a Calling Agent, calling process, Called Agent and called process and 

Figures 6 - 12 are signal flow diagrams for further examples of call setup functions and telephony services. 

Detailed Description of the Preferred Embodiments 

[0017] Figure 1 is a logical block diagram which includes basically all the user interface and functional blocks that 
might be accessible to a particular user. It is intended to be a somewhat comprehensive view of all the ways a user 
might be capable of communicating. In reality, a particular user would typically have access only to a subset of the 
functionality illustrated in Figure 1 The user equipment is generally indicated by 5, and the network is generally indicated 
by 7. The user equipment 5 includes various user interface components generally indicated by 10 such as a camera/ 
scanner 11 , display 12, keypad 14, buttons and indicators 16, media player 18, and media recorder 20 These are each 
connected to one or more service applications generally indicated by 22 which include a video service 24 a fax service 
26, a web service 28, and a voice service 30. Each of the service applications 22 has access to the user interface 
components 10 as required. The voice service 30 is also interfaced with a voice-activated services service application 

[0018] Each of the service applications 22 is interfaced to the network 7 through a respective medium protocol gen- 
erally indicated by 38. The network 7 may include a number of different network types, such as a PSTN (public switched 
telephone network) 34, a cable network 35, and the Internet 36. The medium protocols 38 include video 40 fax 42 T 
120 conferencing 44, H.323 46, wireless/wireline telephony 47, HTTP (hyper-text transport protocol) 48 and IMAP 
(Internet Mail Access Protocol) 52. The interfaces between the network 7 and the terminal 5 are generally indicated 
by 53 and include a transport layer protocol 54 and a physical layer protocol 55. The transport layer protocol 54 provides 
an application independent transport mechanism. Figure 1 has been simplified to collapse the ISO's Session Layer 
Network Layer, Transport Layer and Link Layer to just the Transport Layer. While Figure 1 is intended to be more or 
less comprehensive regarding what capabilities a user's equipment might possess, it is to be understood that a user 
may indeed have additional equipment for interfacing with the PSTN, cable, the Internet, or some other network and 
this equipment may be used in the context of the invention as well. The equipment of Figure 1 may reside on a number 
of different terminals such as a video terminal, a fax machine, a WWW connected computer, a wireline terminal wireless 
terminal, or an H.323 terminal. 

« rm ° re ' V ' eW ° f Fi9Ure 1 ' S 3 '° 9iCal ° nei S ° actual com P° n ents would likely be physically connected differently 
[0019] An abstract view of a multimedia call signalling system (MCSS) according to an embodiment of the invention 
is shown in Figure 2. Whenever any connection is to be made there will always be a caller having a calling terminal 
and a callee having a called terminal. In Figure 2, the caller's user equipment (5 in Figure 1 ) is generally indicated by 
100 and includes various types of terminal including a wireline terminal 102, a wireless terminal 104 and an H 323 
!^ m , ,nal 1 ° 6, The communica t'°ns network is again generally indicated by 7. The network 7 includes an outgoing 
MCSS end system 80 and an incoming MCSS end system 82. The outgoing MCSS end system 80 is the portion of ■ 
the MCSS involved with handling an outgoing call, and this cooperates with the incoming MCSS end system 82 which 
is the portion of the MCSS which handles an incoming call request. In the example of Figure 2, there are two MCSS 
end systems 80,82, the outgoing MCSS end system handling outgoing call requests, and the incoming MCSS end 
system handling incoming call requests received from the first MCSS end system. A completely equipped MCSS end 
system would be equipped to handle both incoming call requests from other end systems and outgoing call requests 
to other end systems, and thus to fulfil the roles of both an outgoing MCSS end system and an incoming MCSS end 
system. A connection which is established by such an MCSS end system while acting upon an outgoing call request 
may be referred to as an outgoing connection, and a connection which is established by such an MCSS end system 
while acting on an incoming call request may be referred to as an incoming connection. In this abstract view this 
network includes various subnetworks required to provide communications links to the caller's terminals These are 
identified further below. Each of the caller's terminals 102,104,106 are connected the relevant portion of the network 
through a respective terminal network interface 1 08, 1 1 0, 1 1 2. The H. 323 terminal 1 06 may be connected to the network 
7 through a dial-up link using Point to Point Protocol (PPP) via a modem, directly connected to the network over 
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Ethernet, connected through IP over ATM or IP over cable modem. The terminal network interface 108 1o, "the wireline 
terminal 102 will be a twisted pair connecting the terminal to a captive office or a public branch exchange (PBX) For 
the wireless terminal 104, the terminal network interface 110 will be the wireless link which connects the wireless 

loot] 3 ' TlTe MOSS S implemented in .arc, part by a Cass of entities which will be referred to hereir , as Call Setup 
Agents. There are three types of Call Setup agents which are used, and these will be referred to as Calling Agents 
Called Agents and Call Agents. An outgoing call is handled by a Calling Agent 114, and an incoming call is handled 
bv fcaTed Agent 116 Each MCSS end system 80,82 has a respective Call Agent 115,117 which acts as an interface 
to the MCSS from telephone company OA&M systems 123,125 and from users through respective user interfaces 
11 9 121 Each of these agents are described in detail below. For the purpose of this example, it is assumed that the 
Calling Agent 114 spawns a Calling Process 187 to handle each outgoing call and that the Called Agent 116 spawns 
a Called Process 189 to handle each incoming call. „ ... n 

[0021] The terminal network interfaces 108,110,112 for calling terminals 102,104,106 are connected to the Calling 
Aoent 114 through respective local network interfaces 109,111 ,113 and a calling presentation driver 120. 
[0022] The presentation driver 1 20 is responsible for exchanging data between the Calling Agent 11 4 and an appro- 
priate one of the local network interfaces 109,111 .113 (and subsequently with the appropriate terminal). 
[0023] Each of the local network interfaces 109,111,113 may be considered a CIP (call intercept point), or a point 
where call signalling is intercepted and diverted from its conventional flow and converted to signals according to the 
MCSS provided by this embodiment of the invention. The local network interfaces have physical layer protocols which 
provide the physical interfaces to the network. Some examples include Ethernet, Point to ^^^^t 
ATM, Frame Relay, analog signalling for POTS, ISDN Basic Rate Interface physical layer, TV Cable, and CDMA for 

ThTcalHng presentation driver 1 20 has access to a terminal profile database 1 22 which contains information 
on the user's terminals 1 02, 1 04, 1 06 and to a user profile database 1 24 which contains information on the user per se. 
The terminal profile for a selected one of terminals 102,104,106 is consulted by the presentation driver 120 to decide 
what type of conversion is required if any, in passing data to and from the selected one of the subscriber terminals 

w£sT' The callee's user equipment (5 in Figure 1 ) is generally indicated by 1 30 and is basically identical to the caller's 
user equipment 100 Again there are three terminals 132,134,136 connected through respective terminal network 
interfaces 138,140,142, to the incoming MCSS end system 82 through a respective local network interface 
1 39 141 143 a called presentation driver 146 and the previously identified Called Agent 116. 
[0026] 'The called presentation driver 146 for the Called Agent 116 has access to a terminal profile database 148 
which contains information on the called user's terminals, and has access to a user profile database 1 5a The > termm 
profile database 1 48 will be consulted for a terminal profile for a selected one of terminals 1 32,1 34,1 36 to decide what 
as type of conversion if any is required in passing data to and from the selected terminal during call setup 

r0027] The presentation drivers 1 20,146 are also responsible for the presentation and routing of the call tothe callee s 
current terminal which may be on a different calling medium that the calling terminal. This is a function of signaling 
the callee's current terminal using the appropriate local network interface depending °n the current terminal of the user. 
The choice of terminal is not made by the presentation driver. Rather, it is made by the Called Agent 116. Thepres- 
40 entation drivers 1 20,1 46, must execute any required signalling conversions from one calling medium to another 

[00281 The presentation drivers use the terminal profile to decide what kind of conversion is needed. When a call is 
established there are one or more connections (call streams). Each stream carries one type of data, for example voice, 
video graphic or data. The presentation drivers will convert data and route it tothe appropriate local network interface^ 
For example a POTS-to-POTS call will always route through a line card. For video signals from a video-on-demand 
45 call, the data will be routed to a co-axial cable. As discussed below, during call setup negotiation, a medium for use in 
establishing a connection is determined. The medium will require a particular transmission protocol which i may differ 
from that expected or generated by either or both of the calling terminal and the user's current terminal. The call ng 
presentation driver 120 must perform a receive type conversion on signals received over the connection from the 
transmission protocol to the calling terminal's native signalling protocol if these protocols differ, and must similarly 
so perform a transmit type conversion on signals to be transmitted over the connection from the calling terminal s na .ve 
signalling protocol to the transmission protocol if these protocols differ. Similarly the called presentation driver 146 
must perform a receive type conversion on signals received over the connection from the transmission protocol to the 
callee's current terminal's native signalling protocol if these protocols differ, and must perform atransmit type conversion 
on signals to be transmitted over the connection from the current terminal's native signalling protocol to the transmission 

55 protocol if these protocols differ. ^ „^,„„ t 

[00291 The presentation driver may, for example, perform codec conversion to convert between different codecs 
used by two different terminals. For example, one end of the call may be a POTS terminate codec usee I is = 64KPCM 
(64 Kilobit Pulse Code Modulation) in order to drive a PSTN line card while the other end may be an H.323 terminal 
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that uses a G.723. 1 codec. In this case the presentation driver has to convert the G.723. 1 codec to the 64KPCM voice 
data format to deliver any voice attachment associated with the call setup. 

[Q030] When graphic data is exchanged, the terminal may not be able to support a certain format of graphics and 
so the calling/Called Agent will instruct the respective presentation driver to convert to the appropriate format. A fax 
signal is a form of graphic format. The fax machine is a terminal which may not support a specific type of encoding. 
The presentation driver may have to convert it to an encoding method acceptable go the fax machine. 
[0031] In some case, a JPEG picture may be sent to a fax machine, and in this case the presentation driver may be 
configured to convert the data to a format accepted by the fax machine. 

[0032] Video has many different formats. Most of the time a terminal would have various different software capable 
of handle various video formats. In some situations the terminal will not accept certain video formats. Video conversion 
is needed when no capable software is available. For example a terminal might only be able to play MPEG 1 (Motion 
Picture Expert Group standard) video in a situation where only MPEG 4 video is sent. Rather than reject the call, if the 
customer has subscribed to the conversion feature, the presentation driver can perform the conversion from MPEG 4 
to MPEG 1. 

[0033] Video conversion is also needed when no compatible hardware is available. For example, when an MPEG 
video is requested to be send out to a TV via cable, the data signal is not compatible. The presentation driver may be 
configured to convert from the MPEG video to the cable signal. 

[0034] A third video conversion scenario involves rate adaptation. If the link in 28.8 K baud, and the encoded data 
rate for a video stream broadcast is 56 K baud, the presentation driver will convert the signal format suitable for 56 K 
dala rale is 28.8 data rate. Sometimes this conversion may require a formal change, e.g. from MPEG to VxTreme. 
[0035] Text may have to be converted from one encoding scheme to another. For example, ASCII (American Standard 
Code for Information Inter-exchange) text may be converted to ISO Unicode and vice versa. For a terminal, which has 
no display, the text data can be converted to speech. 

[0036] Referring again to Figure 2, each of the Calling Agent 114 and Called Agent 116 are connected to a PSTN 
carrier network 170 forming part of network 7 through a respective telephony signalling component 172,174. Similarly, 
they are each connected to a PSN (packet switching network) carrier network 178 forming part of network 7 through 
a respective electronic messaging interface 180,182 (or E-mail server) and through a respective Internet telephony 
signalling components 181,183. The electronic messaging interfaces 180,182 are preferably mail servers and will be 
referred to as such in what follows, and more preferably are MIME E-mail servers. The PSTN carrier network 170 and 
the PSN carrier network 178 may be connected to each other through a bridge 184. The PSN carrier network 178 is 
any traditional Data Network and, for example might be ATM, Internet or Frame Relay. 

[0037] The mail servers 180,182 are used to send E-mail from the Calling Agent 114 to the Called Agent 116. They 
also assume the responsibility of delivering reply mail from the Called Agent 11 6 to the Calling Agent 1 1 4. These servers 
preferably have the functionality of conventional mail servers in addition to some extra processing functions for realizing 
the MCSS. When the Calling/Called Agent 114,116 starts up, it will register with the respective mail server 180,182. 
When one of the mail servers 180,182 receives an E-mail, it will strip the header and pass the contents to the Calling 
Agent 1 1 6 or Called Agent 1 1 4. 

[0038] The mail servers 1 1 4, 1 1 6 preferably take advantage of a conventional mail server's features which include: 

40 1. Address resolution; 

2. Universal support around different networks; 

3. Store and forward technology that can provide a reasonably safe delivery transport layer; 

4. Message storage server which manages the messages; 

5. Provides notification service from the network; and 

6. Wide support to access the contents. 

[0039] Preferably the mail servers 1 80, 182 use the MIME (Multipurpose Internet Mail Extension) format, and this will 
be assumed in what follows. It is Lo be understood thai while MIME encoding is the most convenient presently known 
mechanism for formatting the information to be included in the various electronic messages, other encoding and for- 
matting techniques may be used, as appropriate. It is further to be understood that the mail servers 180,182 can be 
replaced by any reliable electronic message transport mechanism which provides the same or similar function. For 
example, each mail account could be replaced by a URL (universal resource locator) in which case the electronic 
messages would be delivered to the Called Agent on a web server of the designated URL embedded in a web page. 
As another example, a direct TCP/IP connection could be used to transfer the message between the Calling Agent 
and the Called Agent. In this case, the electronic address of the Calling Agent would be a combination of a TCP/IP 
address and a service port number of the TCP/IP connection. 

[0040] The PSTN signalling components 1 72, 1 74 handle the PSTN telephony protocols such as ISDN Primary Rate, 
ISDN basic rate or Common Channel Signalling Number 7. Other per trunk signalling is also supported by these com- 
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ponents Their main function is to complete a PSTN call connection at the last phase of a call setup. The PSTN signalling 
components 172 174are different from the PSTN local network interfaces 109,111. The PSTN local network interfaces 
109 111 intercept calls from the wireline, wireless terminals 102,104 and pass them to the presentation driver 120, 
whereas the telephony signalling components 172,174 are involved with the actual connection of a call after it has 
been intercepted and a decision has been made to connect it over the PSTN carrier network 170. 
[0041] The Internet signalling components 181 ,183 handle Internet call connection at the last phase of a call setup. 
These are usually H 323 Gatekeepers. This Gatekeeper is different from the Call Interception Point Gatekeeper which 
exists in the local network interface 11 3 for the H.323 terminal 106. The Gatekeeper in the local network interlace 113 
intercepts call requests from the H.323 terminal and passes them to the Presentation driver 120, whereas the Gate- 
keeper in the Internet signalling components 181 , 1 83 are involved with the actual connection of a call after it has been 
intercepted and a decision has been made to connect it over the PSN carrier network 1 78. 
[0042] The bridge 184 links the PSTN 170 and PSN 178 together. It is usually called the Voice over IP Gateway. 
This gateway provides three major functions: 

is 1 . Signalling conversion - During the call setup phase, the call setup signalling protocol from one type of network 

is converted to another. 

2 Directory services - The directory system for the PSTN and PSN does not have to be the same. If the PSN is 
ATM or X.25 it can be using the E.164 numbering scheme, and there is still the requirement to do a conversion 
between the letter, region and captive office. 
20 3 Voice transcoding - The codec for the Wireline is 64KPCM, the coded for Wireless can be a different type of 

CELPS (code excited linear prediction) and the Internet can be G.721 or G.723. In order to relay the voice signal 
between the PSN and PSTN, the codec has to be changed form one format to another. 

[0043] Each of the Calling Agent 1 1 4 and the Called Agent 1 1 6 are also connected to a respective address database 
25 1 86 1 88 containing a translation between user identifiers and corresponding E-mail addresses as descr.bed in detail 
below While shown as two logical entities, the address databases 186,188 may consist of one or more actual data- 
bases. Furthermore, the E-mail addresses may be replaced by any electronic address used by an appropriate message 
deliver transport mechanism. ..,.-„ ♦ ^ 

[0044] The Calling Agent 1 1 4 and the Called Agent 1 1 6 are software entities each associated with (logically connected 
30 to) mail servers 180,182. They are activated to process the E-mail messages when these are received by the associated 
mail server The mechanism which the mail servers use to trigger the activation of the Calling and Called Agents 
1 14,116 is an application class identified in the application class tag forming part of the E-mail message body in MIME 
format defined by this embodiment of the invention. 

[0045] The Calling Agent 114 is the entity which handles outgoing calls. The main functions of the Calling Agent 14 

35 is to: 

1 . perform an E-mail address resolution from the called number or Internet address (fully resolved address or alias) 
requested by the caller; 

2. create a unique reference identification for each outgoing call; 
40 3. construct an E-mail to be sent to the Called Agent 116; 

4 process the negotiation of call setup parameters; and 

5. participate in the initiation of the establishment of the real call connection after the callee terminal address and 
the call medium is received and settled through the negotiation process. 

45 [0046] It should be noted that through the address resolution using the information from the address database 1 86, 
the call can be setup on behalf of other devices rather than for the terminal from which the user initiated the request. 
This type of request would be constructed through an appropriate user interface 119. For example, a user can use the 
system to set up a call between the cable company and his/her cable reception box for a movie on demand. The Calling 
Agent 114 will recognize the type of call, movie on demand and engage in a dialog to prompt for more information on 

so what movie is requested. The Calling Agent 114 will include the information in a mail message as part of a call data 
parameter using a CALL_DATA option and will send the message to the cable company's Called Agent. When the 
cable company's Called Agent 116 receives the request, it can reply with an acceptance mail and initiate the down- 
loading of the movie either through multicast or by injecting the video to the cable co-axial circuit connected to the user. 
[0047] Every customer will have a Calling Agent 114 to perform the outgoing call function. The actual implementation 

55 can be done by a process, a thread or a single process action on data structures which represent the Calling Agent 
114 Because the Calling Agent 114 is not necessarily active 100% of the time, and may be event driven, it is more 
complicated to implement the Calling Agent other than by using the separate process or thread technique. 
[0048] Figure 5a is a state diagram for the Calling Agent 114. Each user has one Calling Agent 114 to handle the 
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outgoing call. Once it is started, it may create clones of itself to handle multiple calls from one or different terminals 
from the same user. In this example, it is assumed that the Calling Agent 114 spawns a Calling Process 1 87 to handle 
each call. The state transitions for the Calling Agent 114 are defined in the following table: 



State 


Transition Condition 


New State 


Start 


Succeed On initialization PinH roniQt^r u/ith th^i ; 1 1 ; . — *i_ 

^u^wccu ui i ii ii new ischium ai iu ifcjyibier wun me oignamng oomponents using the 
user's account 


Idle 


Idle 


When a call request is received 


Spawn 


Spawn 


Successfully spawn a calling process to process the call 


Idle 


Spawn 


Failed to spawn a calling process 


Spawn Failed 


Spawn Failed 


Send reject request to the user 


Idle 


Idle 


Received Reply 


Update 


Update 


Relayed the information to the Calling Process 


Idle 



State descriptions: 
[0049] 



State 


Description 


Idle 


Initial state 


Spawn 


Spawn a Calling Process 


Spawn Failed 


Recover after the spawn failed 


Update 


Relay the call related information to the Calling Process 



[0050] The Calling Process 187 is an execution thread or a process to handle the outgoing call. Its main design 
objective is to allow multiple calls to be performed simultaneously so as to handle multiple call streams from one or 
multiple terminals. If multiple calls are initiated from the same terminal at the same time, only one Calling Process is 
used because the processing is still sequential. However in the actual detailed implementation, each call from the same 
terminal in a multiple call request can be handled by one of multiple threads or by sub-processes of the Calling Process 
to simplify the processing. Each thread or sub-process is associated with the Calling Process using the call reference 
specified in each call specification in the mail message. The Calling Process does not interface with the mail servers 
directly. Rather, it constructs the MIME message and requests the Calling Agent to initiate the delivery of the message 
Using this design allows the Calling Process to be independent of the message deliver transport mechanism. The 
states and transitions of the Calling Process are illustrated in Figure 5b. 
[0051] The state transitions for the Calling Process are defined in the following table: 



Initial State 


Transition Condition 


New State 


Start 


Upon receiving the call request from the Calling Agent 


Address Resolution 


Address Resolution 


Successfully maps the Directory Number or IP address/alias to an E- 
mail address 


Call Init 


Address Resolution 


Failed to map the Directory Number or IP to an E-mail address 


Reject Request 


Call Init 


Successfully construct the MIME message and send the E-mail 


Confirm Pending 


Call Init 


Failed to construct the MIME or failed to send the E-mail 


Reject Request 


Confirm Pending 


Receives a call progress reply 


Call Progress 


Call Progress 


Inform the user on call progress 


Confirm Pending 


Confirm Pending 


Receive negotiation reply 


Negotiation 


Negotiation 


Send negotiation reply 


Confirm Pending 
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(continued) 



Initial State 


Transition Condition 


New State 


Negotiation 


Failed to send the reply 


Reject Request 


Confirm Pending 


Receive call accept reply 


Initiate Connect 


Confirm Pending 


Receive disconnect reply 


Reject Request 


Initiate Connect 


Initiate the call connection with success 


Call Complete 


Call Complete 


Inform the Calling Agent on the completion status 


Start 


Initiate Connect 


Failed to establish the call using PSTN signalling or Internet signalling 


Reject Request 


All States 


Receive disconnect reply 


Start 


Confirm Pending 


Receive connect abort request from the Calling Agent 


Abort 


Initiate Connect 


Receive connect abort request from the Calling Agent 


Abort 


Abort 


Send disconnect request to Called Agent 


Start 


Reject 
Request 


Inform user that the call 
request is rejected and clean up 


Start 



[0052] The Called Agent 116 processes the incomingcall request in the mail message. It is activated by the associated 
mail server 182 when an E-mail is received. The application class tag in the E-mail is selected so as to be associated 
with the Called Agent software. In conventional mail systems when the mail server receives an E-mail, a user is notified, 
in this case however it is the Called Agent 116 which is informed. The Called Agent 116 may be implemented as mail 
client software Every customer will have a Called Agent 116 waiting for any incoming call. Once the mail server 182 
receives the incoming mail for the Called Agent 1 1 6, the Called Agent is notified and the E-mail is passed to the Called 
Agent which will extract the call information. 

[0053] The implementation of the Called Agent 116 should support call parallelism. In a PSTN world, users usually 
need to setup one call from one to another. But with multi-media, multiple calls may be needed to support audio, video, 
text messaging, fax transfer or file transfer from one user to another users simultaneously. Therefore, parallelism is 
vital to the success of a multi-media telephony system. The implementation of the Called Agent 116 will be parallel to 
the above described implementation of the Calling Agent 114. It spawns a Called Process 189 to process the call 
request. This will simplify the design of the Called Agent 116. 

[0054] The functions of the Called Agent 116 extracting the call setup request information from received mail mes- 
sages spawning a Called Process 189 to execute the call setup request, and extract the call setup reply information 
and pass this to the Called Process. A state diagram for a Called Agent 11 6 is shown in Figure 5c. The state transitions 
for the Called Agent 116 are defined in the following table: 



State 


Transition Condition 


New State 


Start 


Complete Initialization 


Idle 


Idle 


Call request received 


Spawn 


Spawn 


Created a Called Process successfully 


Idle 


Spawn 


Failed to create a Called Process 


Spawn Fail 


Spawn Fail 


Reported error 


Idle 


Idle 


Received Reply 


Update 


Update 


Inform Called Process 


Idle 



[0055] A Called Process 189 is an execution thread or a process which will serve the call setup. It does not interface 

with the mail server. Rather it gets information from the Called Agent. Therefore, the Called Process can work with 

other mechanisms which deliver the call setup request and call reply messages in MIME format. 

[0056] The Called Process uses the User Profile Database 1 88 to find the current terminal which the callee is working 

on. If the current terminal can terminate the call, the Called Process can construct a reply mail message to accept the 

call. 
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[0057] It can also use information in the User Profile to perform call filtering, for example, to reject calls from a 
particular user or to only accept calls from a list of explicitly specified people. 

[0058] A state diagram for a Called Process is shown in Figure 5d. The state transitions for a Called Process are 
defined in the following table: 



5 





State 


Transition Condition 


New State 




Start 


Received the call setup request 


Activated 


10 


Activated 


User profile requires call hand over to Call Management 


Call Management 


Activated 


User profile requires call hand over to Personal Agent 


Personal Agent 




Call Management 


Call is accepted but requires negotiation 


Accept 


15 


Call Management 


All information is received, 

Oflll oan hp nrPQAntorl to tho near 


Present 




Call Management 


Call is rejected. 


Reject 




Call Management 


Call is completed and no more call setup is needed 


Complete 




Personal Agent 


Call is accepted 


Accept 


20 


Personal Agent 


All information is received. 


Present 




Personal Agent 


wall la ICjCOltJU. 


Reject 


25 


Personal Agent 


ociii it> cuFi ipitsitju cinu no more can seiup needed 


Complete 


Activated 


II i*5 3P^orttoH 
wan i o ctLrUcLficLJ 


Accept 




Activated 


A|| information ic ror i Qi\/ar) 
/nil II 1 JUI l i IclLIUl 1 lo IcOclVcU. 

Call can be presented to the user 


Present 


30 


Activated 


Call is rejected 


Reject 




Activated 


Call is complete and no more call setup is needed 


Complete 




Accept 


Require parameter negotiation 


Negotiate 




Negotiate 


Receive a negotiate reply 


Negotiate 


35 


Negotiate 


Parameter match 


Present 




Present 


Successfully offered to the terminal 


Alert 




Present 


Failed to offer the call 


Reject 


40 


Alert 


Send Alert call progress reply to Calling Agent 


Complete 




Alert 


Connection timed out and call forward option is available 


Forward 




Forward 


Send Forward call progress reply and forward the mail message 


Exit 




Reject 


Send Reject call progress reply to Calling Agent 


Exit 


45 


Disconnect 


Send clean up message 


Exit 




Complete 


Send Disconnect reply to Calling Agent 


Exit 




All States 


Upon receiving a Disconnect from the Caller 


Exit 


50 


All States 


Upon received an abort request 


Abort 




Abort 


Send Disconnect to Caller 


Exit 



[0059] The states in the Called Process state transition diagram of Figure 5d are described in the following table: 



State 


Description 


Start 


Initial state of the process 
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15 



State 


Description 


Active 


The beginning state of handling the call 


Call Management 


When the call is handed off to the Call Management System, the Called Process remains in 
this state until the call is returned from the Call Management System 


Personal Agent 


When the call is handed off to the Personal Agent System, the Called Process remains in this 
otates until thp rail is returned from the Personal Aqent System 


Accept 


The call can be processed to either be presented to the caller or for negotiation 


Negotiate 


Th« /^aii ontorQ thp naramptpr neaotiation orocess 


Present 


r>aii ic nroQpntpH tn thp caller's terminal 


Alert 


The terminal is ringing and the Called Process has informed the Called Agent that the caller's 
terminal is ringing 


Forward 


The call is forwarded to another Called Agent 


Reject 


The call is rejected due to various reasons 


Disconnect 


The call will not be connected. The Calling Agent will be instructed to disconnect the call 


Complete 


The call has been established 


Abort 


The call has to be abruptly terminated 



20 



25 



30 



35 



40 



[0060] In the description which follows, the distinction between the Calling Agent and the Calling Processes which 
it spawns is largely ignored for the sake of simplicity, and a similar simplification is made for the Called Agent and the 
Called Processes. 

[0061] The Call Agents 115,117 are the entities which handles interactions and interfaces with the address database, 
terminal profile and user profile. They also handles the management of the Calling Agent and the Called Agent. User 
or Telephony OA&M systems interact with the Call Agent to maintain the profiles. The following are the functions of 
the Call Agent: 

1. Interface with the Telephony company's Operation, Administration, Maintenance and Provisioning system 
(OAM&P) to configure and maintain the user profile and terminal profile; 

2. Collect calling detail records (CDR), operation measurements (OM) and logs from the Calling Agent and Called 
Agent; 

3. Provide the CDR, OM and logs to the Telephone company's OA&M system; 

4. Accept change of terminal request from the user and update the user profile; 

5. Responsible for the startup and restart of the user's Catling Agent and Called Agent; and 

6. Access the mail account for the user to retrieve call information. If the user would like to review how many call 
have been received today, the number of call setup request E-mails can be retrieved and presented to the user. 
These E-mail records are like caller ID records on a Caller ID Display device. 
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ADDRESS DATABASE 

[0062] A major principle used by this invention is address translation which may be implemented as a form of directory 
look-up. This invention introduces new procedures into the address translation process used by the CO and the Gate- 
keeper and rather than using the native signalling protocol to complete the phone call, an additional layer of signalling 
protocol is introduced to allow the far end to handle the call indifferently for a wireline, wireless, and Internet phone. 
This new protocol does not replace the conventional telephony protocol but adds an additional layer to provide proper 
coupling between different telephone networks. More particularly, call setup signalling is performed through E-mail 
communication between the Calling Agent 114 and the Called Agent 116. Once the type and medium for the call have 
been established, the conventional telephony signalling components 172,174 and/or in the Internet signalling compo- 
nents 181 ,183 are used to complete the connection. 

[0063] For a given user, there will be one or more user identifiers. Each user has a one or more separate user 
identifiers for each type of network identifier for which the user has terminals. For example, if the user has a wireline 
terminal and a wireless terminal, both of these terminals will have an E.164 type network identifier, and can together 
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be represented by a single user identifier which also in E. 164 format. If the user has an H. 323 terminal, then the user 
would have a user identifier which is an H.323 Internet address. The purpose of the user identifier is to provide keys 
into the address database 1 86 which contains a mapping from user identifiers to MCSS Called Agent E-mail addresses. 
For each user of the MCSS provided by this embodiment of the invention, there will be a single unique designated 
Called Agent having a unique E-mail address. Thus, for a user having a E.164 user identifier and an H.323 Internet 
address user identifier, the address dalabase 1 86 will contain a translation from the E.1 64 user identifier to the Called 
Agent E-mail address, and a translation from the H.323 Internet address user identifier to the Called Agent E-mail 
address. It is not necessary that the user identifiers correspond with actual addresses of the user's terminals. The 
requirement for a different user identifier for each network type stems from the fact that a call setup request from an 
H.323 terminal must include an H.323 address, and similarly, a call setup from an E.164 based terminal must include 
an E.164 terminal address. 

[0064] In addition to this translation information, for each user identifier there will be an identification of the types of 
call media supported by the associated terminals. It may also include a quality of service capability of the terminals. If 
a call setup request is received demanding a quality beyond the capability of the destination terminals, this can be 
identified. There may also be a pointer to a system or application which is to process the call setup request for the 
particular terminals. When a call is to be connected through to one of the terminals, the application is activated. 
[0065] This address database may be implemented using LDAP (lightweight directory access protocol) or X.500 
directory services for example, depending upon the design of the network. 

20 TERMINAL PROFILE 

[0066] The terminal profile database 122 contains a terminal profile for each terminal owned by a user and which 
has been registered with the MCSS. When a terminal is being used which is not one of a user's registered terminals 
there will be no terminal profile for that terminal. In this case, a canned terminal profile can be generated dynamically 
based on any information available. Each terminal profile has a reference which can be a string or a number, but which 
is preferably selectable by the user. Preferably, aliases may be used which allow users to identify their terminals using 
names they have personally selected. 

[0067] The terminal profile for a given terminal includes the following information: 
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Network identifier - the terminal identifier of the terminal within its native network. For an H.323 using a dial-up 
service, the terminal identifier is an IP address which is updated by the Gatekeeper after the customer has regis- 
tered (i.e. signed on); 

Terminal Type - Terminal type describes the type of terminal. It can be a wireline, wireless or H.323 terminal for 
example; 

Terminal Capability - This is a list of capabilities which the terminal can perform; 

Subscribed Services - This is a list of subscribed services associated with this terminal. This permits a user to 
subscribe to different services on different terminals, and thus to differentiate the cost of ownership of each terminal. 

USER PROFILE 

[0068] The user profile database 124 contains a user profile for each user. The user profile contains the vital data 
of the user including the user's current terminal. More specifically, it preferably includes the following for each user: 

Legal and Billing Information - This contains the name, and the address for the user's account; 
Mail Account - This is the name of the mail account associated with the user. This account is used to send and 
receive E-mail for call setup or call termination, and is not visible to the user. This account has a unique name 
designed by the provider of the MCSS; 

User Account - This is an identifier of the user's account which the user uses to identify himself/herself to the 
system as a form of authentication when using the MCSS from a terminal which is not a registered terminal. It is 
preferably an alphanumeric and non-case sensitive string so that the name can be entered using a telephone 
keypad; 

User Password - This is used together with the User Account to access the system to change the user profile or 
setup a call from a terminal. The password is preferably alphanumeric such that it can be entered through a tele- 
phone keypad. For advanced systems, the password may be entered through speech recognition technology; 
Private key - This key is needed for non-secured access such as Internet access to permit deciphering a password 
from a terminal which has encryption capability. The terminal will encrypt the password using a public key. The 
private key is not available to the user for security reasons. The private key is assigned by the signalling system 
provider; 
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Subscribed Services - This describes non-terminal related services to which the user has subscribed. This entry 
contains information on what services are subscribed to on every terminal using the MCSS. Examples are a per- 
sonal agent service which permits call filtering or screening, and unified messaging which provides access to a 
mail server; 

Current Terminal - This points to the current terminal associated with the user. The current terminal is only allowed 
to be one of the predefined set of terminals for which terminal profiles exist or can be created dynamically; 
Current Call Management - This points to a current call management description. Call management features are 
offered by the existing telephone company such as a list of terminal numbers which can be activated by name 
dialling, customized announcements for specific calling IDs, offering calling information to the user with the option 
to reject the call, answer with a recorded message, or return a busy signal; 

Quality of Service - This determines the grade of service subscribed to by the user. The user can request automatic 
PSTN to Voice Over IP gateway for long distance using a specific codec, for example. Some codecs require less 
bandwidth which can be more adaptive to Internet delay. The quality of service may also be used to determine 
how a terminal call is to be routed. For example, when a call is originated from the PSTN for connection to H.323, 
this option can be used to determine whether a near end gateway or a far end gateway is used. Near end gateway 
will be cheaper but subject to Internet delay. For end gateway will be higher quality but may result in the requirement 
of paying distance charges. 

[0069] Alternatively, a call may be setup over an ATM network in a private data network rather than over the global 
Internet; 

Personal agent service - This points to any implementation of a personal agent to which the user has subscribed 
or has access. When a call setup request is received, the request can involve the personal agent implementation 
to perform advanced functions such as filtering; 

Call Forward Address - This stores a call forward address. This may be a terminal address of a terminal not 
belonging to the user to which the presentation driver may deliver a call, or a new E-mail address of another Called 
Agent. 

CALL SETUP REQUEST 

[0070] The first step in setting up any call is a call origination from a calling terminal. This will result in a call setup 
request in the protocol of the native network of the particular calling terminal. This may be a conventional call setup 
request which is the same whether or not the MCSS provided by this embodiment of the invention is used. The call 
setup request is intercepted at the call intercept point, this being the local network interface for the particular calling 
terminal. The setup request is then passed through the relevant local network interface and the calling presentation 
driver 1 20 to the Calling Agent 1 1 4. The setup request includes a called user identifier for the called party. Alternatively, 
the call setup request may be generated trough the user interface 19 which permits a more generalized call setup 
request to be made. 

[0071] As described below, the called user identifier is translated by the Called Agent 11 6 to a terminal identifier for 
whichever of the user's terminals is the active or presently selected. 

E-mail MESSAGE STRUCTURE AND CONTENTS 

[0072] Call setup and call reply E-mail messages are used to perform call setup signalling according to this embod- 
iment of the invention. A call setup message is generated once by the Calling Agent to activate call setup activities. 
Thereafter, call reply messages are used for the remaining lifetime of the call setup and may be generated by both the 
Calling Agent and the Called Agent. Each component of a message is referred to as a parameter, and a parameter 
may itself contain parameters. In the following, the contents of the messages are described hierarchically. Messaging 
is preferably done using the RFC 1341, 1342, 1522 and 1531 MIME (Multipurpose Internet Mail Extensions) format. 
The following message formats are defined using BNF's (Backus Naur Forms) but this may not necessarily be the case. 

MIME Signalling Message BNF 

[0073] This is the generic form of any message being used for the MCSS, and applies for both call setup and call 

reply messages: 

<mime-signa!ling>::=<call-setup>l<call-reply> 
In the above, the symbol "I" means that one of the two components it separates is included in the message, i.e. either 
the <call-setup> component or the <call-reply> component. 
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[0074] In response to a call setup request, the Calling Agent 114 constructs a call setup E-mail message addressed 
to the E-mail address associated with the called user identifier. This involves filling in the <call-setup> field of the above 
described generic call signalling E-mail message as follows: 
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<call-setup> : : =<mime«headerxcallinfo><callinfo>*<mime-data>* 
<inime-header> : : = "MIME-Version : 1 . 0 " CRLF 
<callinf o> .- : =<callinf o-headerxcallinf o-bodyxoptions>* 
<at.tachment>*<callinf o-end> 
75 <callinfo-header>: : = "appl ica t lon/x-cal 1 " ; <boundary- 

specif ication> 

<callinf o-body> : : =<cal ler>CRLF<cal led>CRLF <cal 1 -medium>CRLF 

<call-ref>CRLF<call-action>CRLF<quality> 
<caller> : : = "CALLER " SP" ( "<address> [ » , "<nanie>] " ) » 
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<called> : : - " CALL EE " SP" ( "<address> [ tt , "<name>] " ) " 
<medium> : ; "MEDIUM" SP ( "VOICE " | "DATA" | "VIDEO" | " FAX" ) 
<reference>: : PREFERENCE" SP<reference value? 
<quality>: : - " QUALITY " SP<qual i ty- 1 is t> 
<options>: : = "OPTION" SP ( opt ion- 1 is t ) 
<attachments> : :=<mime data> 
<callinfo-end>: : = w - - "<boundary tag> 

<address> : : =<e._164> | <ipxtcp> |<udp> | <rtp> | <url> | . . . 
<e . 164> : : =" ( ,W 'E164 " " , "<ITU E.164 phone number 

specif icacion> " ) " 
< ip> : : = " ("IP""", " < Internet IP address ">" 
<tcp> "TCP" 11 , "<Internet IP address> " : "<number> 
<udp> : — M UDP" 11 , "<Internet IP address>" : "<number> 
<rtp> : =="RTP" u , "<Internet IP address> " : "<number> 
<url> : =="URL" w , "<URL address> 
<medium> : : ="VOICE" | " DATA " | "VIDEO" | "FAX" 

<quality-list>: : = " ( " <quali ty-value><qual ity-value> * " ) " 
<quality-value>: :=<grade> |<delay> | <codec -list> 
<grade>: (""GRADE" " ( " TOLLQUALITY " | "NEARTOLL " | 

" ACCEPTABLE " ) " ) " 
<dclay> : : =" ( ""DELAY" " , "<milliseconds>" ) " 
<codec-l i st> : : =" ( w "CODEC" u , "<rodec> ( " , "<codec> ) *" ) " 
<codec> : : = "H.723 . 1 " | "H.729" | " 64KPCM" | "32 KPCM" | . . . 
<option-lisc> : : = " ( "<opt ion- value> (" , " <opt ion-value> ) *") " 
<option-value>: 

" CHARGEBACK " | "CALLBACK" | "RINGBACK_WHEN_NOT_BUSY " | - - - 
<call_data_list> : =<call_data_value (SP<call_data_value> | NULL ) 
<call_data_value>:=" ("<key>", " <cal l_data_value> " ) " 
<key> : = any data encoded in a data format acceptable by the 

MIME specification 
<value>:= any value encoded in a format acceptable by the MIME 
specification 

SP : : = (<space> | <vertical tab> | horizontal tab> | <line f eed> | 
CRLF : = (<carriage returnxline feed>) (<carriage returnxline 

feed>) * 
<space>: t^space character 
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<vertical tab>: := vertical tab character 
horizontal tab> : : =hor izontal tab character 
<line f eed> : : =line feed character 
<carriage return> : : =carr iage return character 
<name> : : =any MIME acceptable string or data 



CALL REPLY E-mail MESSAGE 

[0075] In response to a call setup message, the Called Agent 116 constructs a call reply E-mail message addressed 
to the E-mail address associated with the Calling Agent 114. in addition, any further communication for the life of the 
call setup is done through call reply messages from the Calling Agent 114 to the Called Agent 116 or vice versa. 
[0076] The reply E-mail content is also encoded in MIME. This involves filling in the <cal!-reply> field of the above 
described generic call signalling E-mail message as follows: 



55 



<call-reply : : =<mime-header><reply-body> 

<reply-body> : : =<reply- tag> " , "<boundary-specif icat ion>CRLF 

<replyxboundary- tag> 
<reply-tag> : : = "Content- type : appl ication/x-call -reply " 
<reply>: : =<progress-indicator> | <connection> | <negotiation> 
<progress-indicator> : : = : CALL_OFFER_ STATUS " SP<non-accept- 

call-state> 

<connection> : : - "CALL_OFFER_STATUS " SP "ACCEPT "CRLF 
<reference>CRLF<progress>CRLF 
( <rnedium>CRL.F) 

(<caller>CRLF<callee>CRLF) 
(<quality>CRLF) * ( <opt ion>CRLF ) * 
(<attachment>CRLF) * 
<non-accept-call-state> : : =" RINGING" | " FORWARDED " | "COMPLETE " 
" ( " "DISCONNECTED" , <reason> " ) " | 
" ( " "REJECTED" , <reason>" ) " 
<negotiation> : : = "NEGOTIATION" CRLF<callinf o> 

[0077] The reply is also used as a mechanism to provide call progress. It is also used as a call accepting notification. 
If the Calling Agent wants to terminate the call before the actual call setup is completed, it can also use the reply 
message to instruct the Called Agent to terminate the call using the <non-accept-call-state> of "DISCONNECTED" 
with a reason in the <reason> field. 

[0078] The actual contents of the reason field can be implementation dependent. It may for example be digitized 
voice (so that the audio clip can be played to the caller) or a text message to inform the caller why the call is rejected. 
However, MIME allows any data type to be encoded to improve the information density of the communication. 
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Explanation o1 the Fields of Call Setup E-mail Messages 

[0079] The following provides detailed information for all the components in the call setup mail messages. The syntax 
defined here follows the MIME design methodology. The data format specified here is designed for extensibility to 
5 handle new parameters and keywords. 
<mime-header> 

[0080] This is required by the MIME specification to indicate the beginning of the contents of the message; 
<boundary-specification> 

[0081] The boundary specification is used to delimit parts in a MIME. It specifies a unique string which is used to 
10 separate one group of data from another. The value of the boundary is defined without the "-" (two minus sign character) 
in the specification, and at the boundary it is prefixed with two minus characters For example, boundary=eot would 
define the string "eot" as a boundary. The boundary would then appear as "--eot". 

Content-type = "application/x-call" 
[0082] This string is a mechanism to identify the E-mail message as one which is to be processed by the MCSS, 
and to thereby distinguish it from an E-mail message serving some other purpose. This mechanism is defined in RFC 
1 341 . The Keyword "application" indicates the following data is the input to an application. The string following the 7" 
is the class of application. It is used as a key to map to an application using a ".mime" profile. The prefix of n x-" is used 
for any application which is not registered with the Internet Assigned Number Authority (IANA). If the MCSS provided 
by the invention is granted a designation for this class of application, the "x-call" could then be changed to something 
20 like "telephony/call". 

[0083] The information is grouped by a boundary using a boundary specification as discussed above. The information 
for the call and characteristics are included in the <call info-body> subsection of <call-info> in the MIME. 
[0084] There may be multiple call <call-info> information units in the MIME message each dealing with a respective 
connection which needs to be established. The result of this is the creation of multiple calls in a single request between 

25 two or multiple terminals. It is assumed that the multiple calls are connected from a first series of one or more terminals 
associated with the calling party to a second series of one or more terminals associated with the called party. For 
example, a caller with an ISDN terminal may request two different outgoing connections to a singled or multiple called 
terminals. Such a multiple call request may be generated through the user interface 199, or directly from the calling 
terminals if the network interfaces are modified to receive such requests. 

30 <caller> 

[0085] This is the component containing the caller information. The information is either an ITU E.164 address (esn 
number) or an Internet address which can be in dot numeric form (e.g. 47.34.5.121 ) or symbolic form (e.g.ck.pcn.nortel. 
com). The <name> option of the caller is a feature which supports the Caller ID function. In PSTN networks, this name 
can be extracted from directories. In the IP world, this would be a name of the originator's choice. 
35 <called> 

[0086] This is the component for callee information. The information is either an ITU E.164 address (esn number) 
or an Internet address which can be in dot numeric form (e.g. 47.34.5.121) or symbolic form (e.g. ck.pcn.nortel.com). 
The address in the <called> field may also be specified by name. This is the equivalent of symbolic dialling. The function 
of the called directory number in this signalling protocol is only to permit E-mail address resolution for the called party. 
40 <reference> 

[0087] In order to identify every call setup request, a unique reference identifier is given to the call setup request. 
When the Called Agent replies, the reference is used to associate the reply with the request. 
<medium> 

[0088] This tag is used to specify the preferred call medium information. The medium of the call that can be estab- 
45 nshed depends on the support of the underlying network(s). The basic types are voice call (like the telephone services 
offered by Bell) data call (e.g. TCP/IP call for data communication) video call (video image communication) or fax (for 
facsimile transmission). The call medium is qualified using a keyword. A few keywords are listed here and include 
VOICE, DATA, VIDEO and FAX. More keywords may be added for additional call media. 
<quality> 

so [0089] Quality is the parameter to express what will be the quality of service. It can be as simple as strings of tokens 
which are bilaterally agreed upon or key-value pairs in strings, e.g. (FRAME_PER_SECOND, 1 0) or a range of values 
( MOD E M_SP E E D , 300 ,2400 , 9600 , 28800) . This parameter is especially important to the H.323 terminals. There is op- 
tion negotiation built into the H.323 protocol family but it is an optional feature. The negotiation cannot always take 
place. Therefore, this parameter provides another alternative to perform the negotiation. If negotiation is required, the 

55 negotiation is done by sending a call request E-mail, such as described in this section, and the reply E-mail such as 
described in the next section back and forth using the same <reference> until both sides are satisfied. 
<option> 

[0090] The option parameter is used to specify call options. Some of the options can be REVERSE_CHARGE, or 
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JOIN, or other telephony features. 



EXECUTJ VE_BARGE_I N 
<ca ll_data_list> 

[0091] This parameter provides any <call-data-value> arguments associated with the call setup. When the Called 
Agent processes the call, the values of these arguments are used to setup the call as required. The following are some 
examples: 
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1 . The <call-data-value> parameter can be a distinctive ringing pattern for a voice call to be played on the remote 
terminal; 

2. In a call for movie on demand; the arguments may be the sound quality, the movie title, the language of the title, 
the viewing format etc. 

<attachment> 

[0092] Attachment is any MIME compliant contents. It can be fax, video, audio or text as defined in RFC 1521 The 
purpose of the attachment component is to enrich the contents of the call request E-mail so that as much information 
as possible can be carried in a single short message. In an outgoing call, additional caller information can be added 
to the call, e.g. a signature file of the E-mail. If it is text, it can be played out on a H.323terminal as a call announcement 
rather than ringing. If it is a graphic, it can be displayed on graphic enabled terminals, e.g. PC or NC based H.323, 
rather than the default call alert user interface. To a great extent, because the attachment will be stored at the E-mail 
server associated with the Called Agent, the user can retrieve the information by any Unified Messaging System such 
as Exchange from Microsoft or Netscape Communicator from Netscape Communications. 

[0093] One or more attachments may be included in the call setup message. There is really no limitation on the type 
of the attachment. Not all attachments may necessarily be processed by all implementations of the Called Agent. 
<address> 

[0094] The address can be the type presented but can also be extended. It can be any E.164 address, Internet 
protocol address, Internet protocol service address etc. 

Explanation of the Fields of Reply E-mail Messages 

[0095] Many of the fields in the reply message are the same as in the setup message, and as such, these will not 
be redefined here. The following fields are specific to the reply message: 
<reply tag> 

[0096] This field contains the application class specification "application/x-call-reply". As in the class specification 
for the setup message, if the I ANA grants a new content type for telephony, this could be changed to content-type- 
telephony/call-reply. 

<progress-indicator> 

[0097] This set of parameters provides information on the progress of the call as in telephony. It helps to inform the 
caller about the current progress. 
<connection> 

[0098] This parameter indicates the acceptance of the call, and is a request to setup the call. 
<non-accept-call-state> 

[0099] This is an indicator of the current status of a call which has not yet been accepted and which may be rejected. 
The state may be RINGING if the callee's terminal is ringing, FORWARDED if the call is forwarded to another Called 
Agent, REJECT if the call is rejected by the callee, or DISCONNECT if the Called or Calling Agent request the termi- 
nation of this call setup request. 
<negotiation> 

[01 00] This parameter informs the Calling Agent or the Called Agent to change some of the setup parameters values. 
It may be the address of the caller, the address of a callee, or the quality of the call for example. 
[0101] The following table contains an example of the contents of a call setup E-mail message: 



Line 


Description 


MIME-Version: 1.0 


MIME header 


Content-type: application/ x-call; boundary=eot 


application class 


CALLER(E164M6137638533, U CK Wong") 


Caller PSTN user identifier for CK Wong 


CALLEE (E1 64,61 32322486) 


Callee PSTN terminal number 


MEDIUM VOICE 


request setup a voice call 
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(continued) 



Line 


Description 


REFERENCE 0034332344 


call reference is the string "0034332344" 


QUALITY ((GRADE, TOLLGRADE), (DELAY.O)) 


sound quality is toll grade with no delay, e.g. 64KPCM 


OPTION ("Rl NG BAC K_WH E N_NOT_BU S Y" ) 


a treatment is requested to inform the caller if the callee is busy 
now 


Content-type: lext; boundary=eom 


tu;„ ^ „ 1 1 L nf , r-> ottarhmonl vwh ir'h ran hp iiRftri rs call ID 

i n is call nas an anacnn icr i l wi i ioi i ^ai i uc uoou ao o&u i ^ 
information. The message may be displayed on an ADSI 
terminal for the purpose of visual call waiting, the information 
can be displayed as part of a call alert on an H. 323 terminal, or 
the information can be used as an announcement of arrival for 
a conference call 


This is a call from C.K.Wong 


The message 


--eom 


End of attachment boundary 


-eoi 


End of the message boundary 



r01 02] The above example E-mail message is from a caller having telephone number 61 36738533 to a callee having 
PSTN user identifier 6132322486 (which may or may not also be the callee's PSTN telephone number), with VOICE 
as the preferred medium, 0034332344 as the setup request reference, grade - tollgrade and delay = 0 as quality 
specifications, the single option RINGBACK_WHEN_NOT_BUSY, and a text attachment containing the text "This is a 
call from C.K.Wong". 

[0103] The following is an example of a call reply message: 



Line 


Description 


MIME-Version: 1.0 


MIME header 


Content-type: application/ x-call-reply; boundary^eot 


application class 


CALL_OFFER_STATUS ACCEPT 


The call is accepted 


REFERENCE 0034332344 


To inform the Calling Agent that this call is for the call which 
has the reference "0034332344" 


MEDIUM VOICE 


The Called Agent agreed to setup a voice call 


CALLER (E164 : 61 37638533) 


The caller's directory number is not changed 


CALLEE (IR47.34.5.121) 


The callee will connect the terminal on an H. 323 terminal. 
Its IP address is "47.34.5.121". 


QUALITY ((CODEC. G.729, G.711), (DELAY, 15)) 


The codec can be G.729 or G.71 1 . The terminal can handle 
a maximum network delay of 1 5 milliseconds for any voice 
packet 


-eot 


End of the message boundary 



OUTGOING CALL INTERCEPTION 

[0104] Outgoing Calls are intercepted in various manners depending upon the nature of the outgoing call. 
Outgoing Call Interception: Wireline Terminal Call 

[0105] When a wireline terminal 102 makes an outgoing call, the call is initially handled by the CO of the telco this 
being the local network interface 109 for a wireless terminal. The CO will do an address translation to find out how to 
deliver the call For the MCSS, the address translation will result in the call being directed to the Calling Agent. The 
call request is forwarded from the relevant local network interface 1 09 to the Calling Agent 11 4 via a message through 
a communications link between the local network interface and the presentation driver 120 such as TCPdP channel 
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established on demand or earlier. 

[0106] The caller's information is collected either from the dialling tone or pulse, or from an IDSN call setup message. 
If this is a normal fax call, it cannot be identified as such until later. However, if the call is done by a two stage dialling 
procedure, which includes a first number for the fax delivery and a second number for the final destination, the type of 
5 the call can be identified by the time Calling Agent is informed. 

[01 07] I n some cases, the call setup can be forwarded to the Calling Agent via a remote SCP query. It is not necessary 
to always be done from the local CO. The address translation can be handled via an SCP (signal control point) database. 
Most of the time now, it is handled by the SCP query. The SCP can reply with where the call is to be routed and with 
what treatment. This is illustrated in Figure 4. In this example, a user makes an outgoing call from a terminal 300 which 
io is initially handled by a CO 302. 

[0108] The local Captive Office sends a query to an SCP 304 to find out where is the called address. The result from 
the query indicates that the called address is at another Captive Office. The call setup request is routed to a System 
Signalling #7 (SS7) network 306. The SS7 network delivers the call setup request to a Local Network Interface 308 
the remote switch. The request is received by the Local Network Interface 308 of the remote switch and passed on 
the presentation driven 20. The presentation driver 120 extracts the information in the CCS7 call setup message and 
passes the call setup request to the Calling Agent 114. 

Outgoing call Interception: Wireless Terminal Call 
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[0109] A Celco uses a similar mechanism to the mechanism used by the above-described lelco to intercept an out- 
going call from a wireless terminal 104. The call setup request is sent to the Calling Agent. 

Outgoing Call Interception for an Internet Call 

[0110] When an H.323 terminal 106 makes an outgoing call, the outgoing call is intercepted by the local network 
interface 113 which in this case is a Gatekeeper. 

[0111] Preferably, the Calling Agent will be the Gatekeeper for all the outgoing calls. This minimizes overhead and 
duplication. Alternatively a separate Gatekeeper may be used. One attribute required for an H.323 terminal is its IP 
address. If the Calling Agent does not handle the Registration and Administration Service for the dial-up line, the 
Gatekeeper performing Registration and Administration Services has to update the Calling Agent on the IP address. 
[0112] The callee information is in an H.245 call setup request. The information can be extracted and forwarded to 
the Calling Agent. 

[0113] In a specific implementation, the Calling Agent can be extended to support the H.323 call setup. 
35 CALLED AGENT MESSAGE PROCESSING 

[0114] The Called Agent, upon receipt of a call setup E-mail message together with the Calling Agent is responsible 
for coordinating the setting up of a connection between the calling terminal and one of the callee's terminals. In some 
cases, the Called Agent may respond with a call reply message. After the appropriate medium has been identified 
through negotiation if necessary, the relevant native signalling components are used to setup the connection, these 
including the telephony, signalling components 181,183 and the Internet signalling components. 



40 



45 



How to Connect a Call from a PSTN Terminal to PSTN Terminal 

[0115] For the purpose of this example, it is assumed that a connection from a wireline terminal 102 to a wireline 
terminal 1 32 is to be made. 

[0116] Once the E-mail is received by the mail agent of the called party, the Called Agent (which is an application 
associated with the mail server) will process the E-mail. The association of the Called Agent program is done by the 
application tag in the MIME. The Called Agent will extract the called terminal identifier. There are two treatments that 
50 can be applied: 

1. The Called Agent will interact with the telephony signalling components 172,174 to establish a voice channel 
from the captive office associated with the mail server to the captive office where the caller's call was intercepted. 
The channel is established using the caller's phone number in the E-mail. This ensures a voice channel is available. 
55 Then the Called Agent will use the local CO facility (in the local network interface 109 for the wireline terminal 1 02) 

to present the call to the callee based on the information associated with the callee's current location record main- 
tained in the User Profile database. When the callee picks up the phone, the voice channel between the caller and 
callee is bridged. The setup process finishes after a reply message with CALL_OFFER_STATUS COMPLETE is 
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sent to the caller. 

2 The Called Agent will inform the Calling Agent regarding the current location of the callee in a reply mail. The 
<reference> in the E-mail is used to relate the reply to the call. Then the Calling Agent can establish a call to the 
callee's current true location using the existing conventional telephone protocol with the telephony signalling com- 
s ponents 172,174. Either party can finish the call setup by sending a reply message with CALL_OFFER_STATUS 

COMPLETE to the other party. 

How to connect a call from an H.323 terminal to a PSTN terminal 

10 [0117] When the calling terminal is a PSTN terminal and the called terminal is an H.323 terminal, the call cannot go 
through directly When the user's H.323 terminal 106 originates an outgoing call, it sends the request to the local 
network interface 1 1 3 which is the H.323 Gatekeeper. The Gatekeeper has the responsibility of performing the address 
lookup (because the address can be symbolic or alias names) which requires the address to be resolved into number 
dot notation (e.g.bmerib71 .nortel.com is translated to 47.34.5121). This function is similar to the address translation 

is in the PSTN Captive Office. 

1 The dot notation address of the callee is used as a key to query the callee's information in the address database 
186. This database maintains the mapping between the Internet address to the E-mail address of the callee's 
Called Agent. 

20 2. The caller and callee address information, call medium, and other parameters are used to construct the E-mail 

for the call setup request. 

3 The E-mail is sent to the callee's Called Agent. The Called Agent will respond with an E-mail including the 
callee's terminal identifier which will be an PSTN E.164 address. The Calling Agent makes a decision of whether 
the call is to be connected through the PSTN 1 70 orthe PSN 1 78 or both based on billing and quality considerations. 
25 Once it is established that the calling terminal is an H.323 terminal and the called terminal is a PSTN terminal, 

there are existing procedures for using the PSTN telephony signalling components 172,174, the internet signalling 
components 181,1 83, the PSTN 1 70, bridge 1 84 and PSN 1 78 to make a connection. 



30 



How to present a call from PSTN terminal to an H.323 terminal 



[01 1 8] When the callee is an H.323 terminal, again the call cannot go through directly. The Called Agent will construct 
a reply to inform the Calling Agent that the destination is actually an Internet address. The Calling Agent will route the 
call through either the PSTN or PSN depending upon billing and quality considerations. Once it is established that the 
calling terminal is a PSTN terminal and the called terminal is an H.323 terminal, there are existing procedures for using 
35 the PSTN telephony signalling components 1 72, 1 74, the internet signalling components 181,1 83, the PSTN 1 70, bridge 
184 and PSN 178 to make a connection. 

[0119] In the two scenarios involving an H.323 terminal and a PSTN terminal, the quality option can be used to define 
the quality of service on an Internet phone call. Some of the options can be: 

40 1. codec - because an H.323 terminal can decode a small number of compressed voice data, the type of codec 

must be explicitly stated; 

2. link-speed - some H.323 terminals are linked by modem. Therefore, the communication link cannot exceed 
certain bandwidth. 

3. video-data format - since H.323 can also support ITU standard T.120 (video conference), it may be necessary 
45 to specify parameters such as compression method and the data rate. 

How to connect an H.323 terminal to an H.323 terminal 

[0120] When connecting two H.323 terminals, the reply mail will contain Internet addresses for the caller and the 
so callee. The Internet signalling components 181 ,183 can use the information together with the quality and option infor- 
mation to establish the call. 

[0121] It should be noted that after a TCP/IP connection is established by the H.323 terminal for communication, the 
<grade> component in the E-mail can be used to specify the quality of service using the RSVP (resource reservation 
protocol) protocol. One of the problems with the RSVP protocol is that is it is receiver originated. Without the <grade> 
55 information, the callee where data is received can request the highest quality while the caller has to pay for the service. 
With the <grade> information, which can be a user feature to reduce the grade of service, the caller will not be over- 
charged. 



20 



RN.qnncm- <fp 092491 SA2 I > 



EP 0 924 918 A2 



CALL SETUP WALKTHROUGH 
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[0122] A call setup walkthrough will now be described in detail with reference to Figure 3. 

[0123] To begin, a user will originate a call from some calling terminal 200 (this being a particular one of the user's 
available terminals 102,104,106 shown in Figure 2) resulting in a call setup request being generated. The call setup 
request which contains the callee's user identifier is passed through the terminal network interface (not shown) and 
the local network interface where it will be intercepted, converted to a generic form by the presentation driver (not 
shown), and passed to the Calling Agent. In POTS, the call is intercepted by the captive office. In GSM/PCS, the call 
is intercepted by the ground station or the cellstation. In an internet call, the call is intercepted by an Internet gatekeeper. 
[0124] Next, the Calling Agent 114 examines the called user identifer contained in the setup request and looks up a 
corresponding destination E-mail address in the address database (not shown). The Calling Agent will then generate 
an outgoing E-mail message to the address as described above. The E-mail message is then delivered by the calling 
end mail server 180 to the called end mail server 182 over the Internet. This E-mail should always be sent using the 
highest priority. The mail servers 180,182 should observe this priority and deliver the message as quickly as possible 
Furthermore, messages received by the called end mail server 182 need to be processed quickly, almost in real time 
and to be passed quickly to the Called Agent 116. 

[0125] As soon as the mail is delivered to the Called Agent 11 6 : the Called Agent will examine the contents of the 
E-mail message. The call originator's information will be extracted from the message. The Called Agent will identify 
the current terminal associated with the called party by looking up the relevant record in the user profile. There may 
be a negotiation stage (not shown in Figure 3) during which call parameters are negotiated and settled. The Called 
Agent will then present the call to the current terminal using the native call setup. If the user is now associated with a 
cell phone, the call is delivered to the ceico. If the user is now associated with the PSTN, the call is delivered to the 
telco. If the user is now associated with an H.323 terminal, the Called Agent will use H.323 to establish the call The 
Called Agent will determine whetherthe preferred medium identified in the message matches that of the current terminal 
type. If it does not match, then a conversion is attempted. If no such conversion is possible, the call will be rejected 
with an appropriate reason. The rejection may be returned via a mail message with video, text, voice message and 
other multi-media data. The Called Agent may also choose to present the attachments to the destination terminal as 
part of the call presentation which, for example, may display graphics, video clips, audio clips, or alternative ringing. 
The Called Agent may also be configured to perform a personal agent function which for example may display incoming 
calls and respond to screened calls accordingly. 



Supplementary Services 



[0126] Preferably, conventional telephony services can be implemented or supported by this signalling system The 
architecture of the network using this protocol is fundamentally indifferent from the existing implemented telephony 
network. Many of the services can be preserved. However, some of the call setup and billing support can be imple- 
mented differently. The following sections outline how to implement these using the capability offered by this invention. 



CLASS Service 



[0127] CLASS is Common Local Area Signalling Service. It provides a number of services ranging from display 
message to different ringing tone. These capabilities are readily available using the attachment components in the 
MIME message as described previously. The advantage of the signalling protocol is that video and graphics can also 
be added. 



Caller ID 



[01 28] Caller I D refers to the caller's directory number (or the caller's I P address) and a character string corresponding 
to the name. The calling directory number is part of the call setup in PSTN. The character string relies on the local 
white page database. The current existing protocol cannot include the character string in the call setup signalling and 
as such Caller ID does not include the name in long distance calls. However, the invention provides the opportunity to 
include this information which makes the Caller ID name service extendable across long distance areas 



Call Forward 



[0129] Call forward means the user of a particular directory number would like to receive future incoming calls at a 
different location. This can be easily done by changing the current terminal associated with the user. 
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Simple Call Management 



[01 30] The Agent based architecture provides an additional business opportunity for the telephone networks which 
may not otherwise be easily extended to support multi-media. The following describes three typical call scenarios which 
provide new capability for users. Collectively, all these scenarios can be treated the same way. 



55 



Destination Busy 



[0131] When the destination is busy, the typical treatment is to let the caller decide to retry later. Addition opportunity 
and implementation may be made available to charge the user on a per usage basis to ring back. This can be an option 
specified by the caller in the user profile. 



Call Not Answered 

is [01 32] When the callee is not around the terminal, the call can be offered, but no body is going to answer it 
Call Rejection 

[0133] Because of the attachment, a callee will know who is calling. The call can be rejected from an H.323 terminal 
20 or an ADSI terminal with a visual call waiting feature. 

Treatment 

[0134] When one of the above scenarios happens, the user can be presented with the following options: 

25 

1. leave a voice message for the callee in which case the message will be digitized by the Calling Agent. The 
digitized message will be sent and attached to a call setup reply message as an attachment. 
2 send a fax to the caller which can be retrieved by the callee later. The fax will be stored by the Calling Agent 
and sent to the Called Agent which will attach the fax to a call setup reply message as an attachment. 



Unified Messaging Support (UMS) 



[01 35] This invention allows the telephony services to evolve around a UMS. Users can use the UMS to get the caller 
id record, voice message, fax message or event text message. 



Call Transfer 



[01 36] If the call transfer is within the same network, existing telephony protocols (except Internet terminal) have a 
well defined procedure to handle the transfer. These are replicated here. 
40 [01 37] This invention does not provide a new support to transfer calls between different networks or media. However, 
because the Calling Agent and Called Agent can be extended to monitor the life cycle of a call, it can provide support 
and coordinate the transfer calls between different networks and media using the following procedures. 



Transfer Between Different Network Types 
[01 38] 



1 . The user will signal the Agent (Calling or Called Agent) to perform the call transfer either through in-band (flash 
and dial) or out-of-band signalling from another terminal. 
so 2. The Agent will request the local network interface to disconnect the voice channel connected to terminal. 

3. The Agent will command the interface to the telephony network. 

4 Another call is established to the new destination under the control of the Agent through a gateway. 

5. After the new call to the new destination is established, the voice channel from the network is routed to the new 

destination. 
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Transfer Between Different Media Types 
[0139] 

1 . The user will signal the Agent (Calling or Called Agent) to perform the call transfer either through in-band (flash 
and dial) or out-of-band signalling from another terminal. 

2. The Agent will request the local network interface to disconnect the voice channel connected to terminal. 

3. The Agent will command the interface to the telephony network to suspend the call. 

4. Another call is established to the new destination under the control of the Agent through a gateway. This gateway 
will be responsible for the conversion of the medium type, e.g. codec. 

5. After the new call to new destination is established, the voice channel from the network is routed to the new 
destination. 

Detailed Description of Call Transfer Interface 
From PSTN Network 



[0140] The first step in switching to another terminal is to. suspend the current call and signal the switch for the 
transfer. The following scenarios describe the common procedure used to suspend the current call and signal the 
20 switch for the transferring. 

1 . From an analog terminal, user will flash and perform a call forward operation. 

2. From a digital set, e.g. ISDN, the terminal will send a supplemental service message to request the terminal to 
be forwarded. 



[0141] Once the call is suspended, the user can signal a request to be connected to the Call Agent which can handle 
the call transfer. One way to request to be connected to the Call Agent is to use the "*nn" convention. For example, 
the code "*1 1 " can be assigned for this function. 

[0142] After the call is suspended, the user can press "*1 1 " and log on to the Calling Agent with appropriate identi- 
30 fication and authentication. From the data where the input is coming from, the Calling Agent can identify the suspended 
call. Then the user can instruct how the call will be forwarded. There are two treatments to his request. 

1 . The feature can limit the transfer among the terminals subscribed by the user. It does not allow the user forward 
to any other terminal. However, if the user wants to forward to any other terminal, there may be an existing call 

35 forward supplementary feature to support it. 

2. The call forward can be to the terminals for which the user subscribed to the service and any other terminals. 
In this case, the interaction can be designed to prompt the user to determine which kind of transfer will be required. 
For the subscribed terminal, the user can select from a list presented by the Calling Agent. For any other terminal, 
the user enters the destination directory number. The Calling Agent will use the existing supplementary services 

4 o to perform the call transfer. There are two treatments to support this service. In the first, the customer must sub- 

scribe to the supplementary service before it can use this feature, and in the second, the telco/celco can charge 
the user on per usage basis. 

[0143] If the destination is a PSTN directory number (DN), the switch can use existing software to perform the call 
45 forwarding. 

[0144] If the destination is an H.323 terminal, the call is routed through Voice Over IP Gateway. 
From H.323 Terminal 



[01 45] If the destination is another H.323 terminal, it can use the supplementary services to be defined for the H.323 
to perform the call transfer. 

[0146] If the destination is a PSTN terminal, the call can be routed to an Internet Terminal Gateway. 
Alternate Access to the Calling Agent 

[01 47] When a customer is away from the set of registered terminals, he can access the Calling Agent using different 
vehicles. This section describes several possible implementations. 

[0148] All these procedures incur the authentication of the user. The charge can be made to the user's account rather 
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that the owner of the terminal. 
Access from POTS or Equivalent 

5 [0149] The following procedure can be used from a terminal which has a telephony key pad and no other display 
device such as a POTS terminal. 

1 Dialing a special designated terminal number which will connect the voice channel to a IVR (interactive voice 
response) system which is a front end of the Calling Agent. This IVR system will collect the information and forward 

10 the information to the Calling Agent. 

2. Log on using the user's account name and password. 

3. The IVR system prompts the user tor the destination terminal number. 
4 |f there is no called address handler go to step 7. 

5. If called address has a handler, the handler will be activated and connects to the voice channel. 
is 6. When the called address's handler has finished, go to step 7. 

7. Calling Agent constructs the MIME message and uses MCSS to establish the call. 

Access from ADSI Terminal or Equivalent 

20 [0150] The following procedure can be used to establish a call from an ADSI (analog display services interface) 
terminal which has a display and programmable buttons. 

1. Dial a special number on an ADSI server which has support for MCSS. 

2 The user performs the log on using the user's account name and password. 

25 3. The ADSI server will download an ADSI script to prompt the user with additional destination information such as: 

callee address 

medium (e.g. voice or fax) 

quality (using PSTN long distance or through Internet Gateway) 

4 If there is a callee address handler, an ADSI script can be downloaded to the terminal to acquire more information. 
5. When the data input is completed, the Calling Agent receives all the information and proceeds with the call setup. 
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Access from an H.323 Terminal with Web Browser Support 

[0151] The following procedure can be used to establish a call from an H.323 Terminal with Web Browser support. 
1 Access a Universal Resource Locator of the Calling Agent 

2. Perform log on using the user name and password with encryption enabled and a public key used. 
40 3 The Calling Agent's Web interface will download a form to acquire the callee address information. 

4 If there is a callee address handler, the callee address handler will send another form to collect more data. 
5. After all information is collected, the Called Agent performs an Internet terminal call setup on behalf of the caller. 
The call will be a callback type which means the destination call originate the H.323 call. 

45 Create Attachment for the Call 

[0152] The call setup E-mail has the capability to include fax, video clip and voice clip. The following description 
outlines how these contents can be created and included in the MIME message. 

so Attach Voice Clip to a PSTN Call 

[0153] The following procedure can be used to create a call with a voice clip included. 

1 . User calls a special number to connect to the Calling Agent. 
55 2. The user will use the password to authenticate his/her identity. 

3. The user records a voice clip. 

4. The user instructs the Calling Agent to call a destination. 
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Attach Fax to a PSTN Call 



[0154] The following procedure can be used to attach a faxed document to a PSTN call. 

5 1 . User calls a special number to connect to the Calling Agent. 

2. The user informs the Calling Agent to prepare a call with a Fax attachment. 

3. The Calling Agent gives a terminal number and password to the user. 

4. The terminal number is a fax reception server. The password allows an association of the fax uploaded and the 
current call request. 

to 5. The user dials the terminal number to prepare the fax. 

6. The fax server will ask the user to enter the password. 

7. If accepted, the fax protocol for transmission is carried out. 

8. Once the fax transmission is complete, the Calling Agent can construct the MIME message to establish the call 
or just deliver the Fax. 

75 

[01 55] I n an alternative to this procedure a user can access the fax server, with proper authentication using password, 
and fax the document. The fax server will provide a fax identification which can be used to instruct the Calling Agent 
to extract the fax from the fax server to construct the MIME message. With this technique only one terminal call is 
active at a given time so the user can have a single line for fax and voice call. 
20 [0156] Similar functions can be executed on a PC which connects to the Calling Agent via a dial up line or Ethernet. 
In this case, the file can be sent to an FTP (file transfer protocol) server rather than a Fax server. 

Access to MIME Messages Through UMS 

25 [0157] The call setup messages are delivered as MIME message. They can be stored on a Unified Messaging Sys- 
tems' (USM) message server such as Microsoft's Exchange, Sun's Solstice or Lucent's Intuity. The interface to these 
message will provide access to various components constituting the call setup message. 

Caller Information 

30 

[0158] The caller's call setup requests are stored as E-mails or messages on the Unified Messaging System. These 
E-mail are the equivalent of the caller identification records on a Caller ID device. 

Attachment 

35 

[0159] The UMS interface can retrieve and present the attachment (such as the text message, voice message, fax 
or even video) to the user. 
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Signal Flow Examples 

[0160] Various signal flow examples will now be described with reference to Figures 6-12. In these figures, the num- 
bered arrows represent message flows. 

[0161] Figure 6 shows the message flow for a basic voice call. In step 1 , the Calling Agent constructs the call setup 
request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server sends the 
E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server. In step 4, the Mail Server 
notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, the Called Agent issues a command 
(using the mail protocol) to retrieve the E-mail. In step 6, the E-mail is delivered to the Called Agent. In step 7, the 
Called Agent constructs a reply and sends this to the mail server. In step 8, the mail server sends the E-mail to the 
PSN. In step 9, the E-mail arrives at the Calling Agent's mail server. In step 10, the mail server sends a notification to 
the Calling Agent. In step 1 1 , the Calling Agent requests the mail server to deliver the E-mail. In step 12, the mail server 
delivers the E-mail to the Calling Agent and the Calling Agent uses the information in the reply message to establish 
the call. 

[01 62] Figure 7 shows the message flow for a voice call with no answer. In step 1 , the Calling Agent constructs the 
call setup request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server 
sends the E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server. In step 4, the Mail 
server notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, the Called Agent presents 
the call to the terminal through the presentation driver. In step 6, the user creates an attachment. The attachment can 
be voice message, fax, or graphics. The Calling Agent creates a reply message and passes it to the mail server. In 
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step 7 the mail server sends the E-mail. In step 8, the mail is delivered to the Called Agent mail server. In step 9, the 
mail server sends a message arrival notification to the Called Agent will store the reply message with attachment to 
be retrieved by the user later. „„,.,„ 
r0163] Figure 8 shows call forwarding to another MCSS user. In step 1 , the Calling Agent constructs the call setup 
request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server sends the 
E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server. In step 4, the mail server 
notifies the mail client which is the Called Agent 1 of the arrival of the E-mail. In step 5, the Called Agent 1 requests 
the mail server to deliver the E-mail. In step 6, by examining the user profile, the Called Agent 1 finds out that the call 
is to be forwarded to another user handled by Called Agent 2. In step 7, the Called Agent 1 instructs the mail server 
to forward the E-mail to the Called Agent 2. In step 8, the mail server delivers a message arrival notification to Called 
Aqent 2 In step 9 the Called Agent 2 requests the mail server to deliver the mail. In step 10, the call setup request 
message is sent to the Called Agent 2. The Called Agent 2 can either initiate negotiation or accept the call. 
f01641 Figure 9 shows the voice message service/personal agent service. In step 1 , the Calling Agent constructs 
the call setup request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server 
sends the E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server. In step 4, the mail 
server notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, after consulting the user 
profile the Called Agent constructs a reply message which will connect the call to a voice message service server or 
a personal agent service server. The redirection in done by specifying the called address of where the call can be 
completed by the Calling Party. The reply message is passed to the mail server. In step 6, the mail server sends this 
to the network In step 7, the reply mail is delivered to the mail server. In step 8, the mail server sends a message 
arrival notification to the Calling Agent. In step 9, the Calling Agent requests the mail server to deliver the message. 
In step 10, the mail server delivers the reply message to the Calling Agent. The Called Agent examines the contents 
of the reply and determines the call is accepted, and instructs the signalling components to complete the call without 
answering. The call is actually delivered to a voice message service or personal agent service. 

r01 651 Figure 1 0 shows the "follow me" scenario. The user is now at a terminal which is not controlled by the Called 
Aqent for the user He/She first connects to the Call Agent of the user. He/She instructs the Call Agent to change the 
user profile to deliver calls to a specific terminal by giving its address. The Call Agent for the user collects the information 
and updates the user profile to be used by the Called Agent. In step 1 , the Calling Agent constructs the call setup 
request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server sends the 
E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server. In step 4. the Mail Server 
notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, the Called Agent requests he 
mail server to deliver the E-mail. In step 6, by examining the user profile, the Called Agent finds our that the call is 
forwarded to Terminal A. In step 7, the Called Agent constructs a reply message which accepts the call with Terminal 
A's address as the Callee Address. The message is passed to the mail server. In step 8, the mail server send the mail 
to the PSN In step 9 the PSN delivers the mail server. In step 10 the mail server sends a message arrival notification 
to the Calling Agent. In step 11, the Calling Agent requests the mail server to deliver the message. In step 12, the mai 
server delivers the E-mail to the Calling Agent. The Calling Agent extracts the message and finds out it is an accept 
reply message. It instructs the telephony signalling components to complete the call using the address in the reply 

r01661 9e Fiqure 11 , shows a multi-media message with attachment. The user connects to the Call Agent to provide the 
contents of a multi-media message. The user can record a voice message. He/She can fax the document to the Call 
Aqent He/She can upload an electronic file using File Transfer Protocol to the Call Agent. The Call Agent provides an 
identity to even/ artifact stored. The user connects to Calling Agent and instruct the Calling Agent to establish an 
outgoing call using the artifacts stored at the Call Agent. The Calling Agent asks the Call Agent to provide the artifacts 
« using the id provided by the user. The Call Agent sends the electronic copy of the artifact to the Calling Agent. In step 
1 the Calling Agent constructs the call setup request message with all the artifacts as attachments and sends it to the 
mail server to be sent to the Called Agent. In step 2, the mail server sends the E-mail to the PSN network. In step 3 
the E-mail arrives at the Called Agent's mail server. In step 4, the Mail Server notifies the mail client wh.ch is the Called 
Aqent of the arrival of the E-mail. In step 5, the Called Agent issues a command (using the mail protocol) to retrieve 
so the E-mail In step 6, the E-mail is delivered to the Called Agent. In step 7, the Called Agent extracts the attachments 
and presents them to the terminal selectively according to the terminal capability described in the terminal profile. Later 
it constructs a reply and sends this to the mail server. In step 8, the mail server sends the E-mail to the PSN. In step 
9 the E-mail arrives at the Calling Agent's mail server. In step 10, the mail server sends a notification to the Calling 
Agent In step 11 . the Calling Agent requests the mail server to deliver the E-mail. In step 12, the mail server delivers 
£5 the E-mail to the Calling Agent. The Calling Agent extracts the contents in the reply message to terminate the call with 
information in the reply or initiate negotiation or initiate a call setup using the signalling components. 
F01671 Figure 12 shows a multiple multi-media call setup. The user connects to the Calling Agent and requests a 
multiple-call setup request. The Calling Agent redirects the user's call to an IVR system to collect the multiple call setup 
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request. When the data collection is complete, the I VR system passes the multiple call setup request the Calling Agent 
In step 1 , the Calling Agent constructs the call setup request message with multiple call requests In step 2 the mail 
server sends the E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server In step 4 
the Mail Server notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, the Called Agent 

s issues a command (using the mail protocol) to retrieve the E-mail. In step 6, the E-mail is delivered to the Called Agent 
In step 7, the Called Agent extracts the call requests from the message and constructs a reply to accept all the calls 
In step 8, the mail server sends the E-mail to the PSN. In step 9, the E-mail arrives at the Calling Agent's mail server. 
In step 10, the mail server sends a notification to the Calling Agent. In step 11, the Calling Agent requests the mail 
server to deliver the E-mail. In step 1 2 the mail server delivers the E-mail to the Calling Agent. The Calling Agent sets 

10 up calls using the address information in the message. 

[0168] An attachment may be presented to the terminal without completing the call if the called party chooses this 
option. 

[0169] Numerous modifications and variations of the present invention are possible in light of the above teachings 
It is therefore to be understood that within the scope of the appended claims, the invention may be practised otherwise 
15 than as specifically described herein. 

[0170] In the illustrated embodiments, the Called Agent and the Calling Agent are network components Alternatively 
these can be migrated to terminals. This can be realized by a network-wide distributed implementation of these com- 
ponents. 

[0171] In summary, the invention provides a system and method for performing call signalling for multimedia call 
setups. A user equipped with calling terminals of various types may initiate a call from any of these terminals and the 
call is intercepted and handled by the system. A calling agent looks up an E-mail address for the called party and 
sends a setup request E-mail to a called agent associated with the called party. The called agent determines the current 
termmal that the callee is using, and together with the calling agent a call medium and other parameters are established 
Then a connection is made between a calling terminal and the current terminal. This provides a generic signalling 
system for a callee using a wireline terminal, wireless terminal, or H.323 terminal to be connected to a called terminal 
also being any one of these or other types. 
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1. A multimedia call signalling end system comprising a calling agent for connection to a network for coordinating 
the establishment of a connection between a calling terminal served by the calling agent and another terminal the 
calling agent comprising: 

a) means for receiving a call setup request including a user identifier; 

b) means for looking up an electronic network address corresponding with the user identifier; 

c) means for generating a call setup electronic message with said electronic network address and sending it 
to said address; and 

d) first means for coordinating the establishment of an outgoing connection between a calling terminal and 
40 the another terminal. 



2. 

45 3. 

4. 

50 
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A system as claimed in claim 1 , wherein said means for receiving a call setup request receives the request from 
the calling terminal. 

A system as claimed in claim 1 or claim 2, further comprising a user interface for receiving the call setup request. 

A system as claimed in any one of claims 1 to 3, further comprising a terminal profile database containing a terminal 
profile for each of a user's terminals which are served by the system including a terminal type for each terminal, 
wherein the calling terminal is one of the terminals. 

A system as claimed in any preceding claim, wherein a canned terminal profile is used when the calling terminal 
is not included in said terminal profile database. 

A system as claimed in any preceding claim, further comprising a user profile database containing an identification 
of which of said user's terminals a user is currently using. 

A system as claimed in any preceding claim, further comprising an address translation database containing a 
mapping from said user identifier to said E-mail address. 
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8 A system as claimed in any preceding claim, wherein said outgoing connection is established over a packet 
switched network or a public switched telephone network depending upon billing and quality considerat.ons, in 
cooperation with signalling components with the selected network. 

5 9 A system as claimed in any preceding claim, further comprising local network interfaces between the calling agent 
and each of the user's calling terminals for supporting calling terminals of various types including cellular terminals, 
wireline terminals, and H.323 terminals. 

10 A system as claimed in any preceding claim, further comprising a calling presentation layer between the calling 
10 agent and the calling terminal for performing a receive type conversion on signals received through the outgoing 

connection from said another terminal from the transmission format used over the outgoing connection to a calling 
terminal format required by the calling terminal if the calling terminal format is different from the transmission format, 
and for performing a transmit type conversion on signals to be sent through the outgoing connection from the 
calling terminal format to the transmission format if the calling terminal format is different from the transmission 
is format. 

11. A system as claimed in any preceding claim, further comprising a called agent for handling incoming call setup 
electronic messages, the called agent comprising: 

20 a) means for receiving an incoming call setup electronic messages, the incoming call setup electronic message 

including a user identifier; 

b) means for looking up a current terminal identifier which identifies a current terminal associated with the user 

identifier; and . 

c) second means for coordinating the establishment of an incoming connection between the current terminal 

25 and another terminal which originated the call setup. 

12 A system as claimed in any preceding claim, wherein the network comprises a packet switching network (PSN) 
and a public switched telephone network (PSTN), and wherein said first means for coordinating the establishment 
of an outgoing connection participates in the selection of eilher the PSN or the PSTN for the outgoing connection, 
so and then cooperates with a native signalling component for the selected network to make the outgoing connection, 

and wherein said second means for coordinating the establishment of an incoming connection participates in the 
selection of either the PSN or the PSTN for the incoming connection and then cooperates with a native signalling 
component for the selected network to make the incoming connection. 

35 13 A system as claimed in any preceding claim, wherein said first and second means for coordinating the establish- 
ment of an outgoing and incoming connection respectively participate in a determination of a transmission format 
each said connection, the system further comprising: 

a called presentation layer between the called agent and the current terminal for performing a receive type 
conversion on signals received through the incoming connection from a transmission format used over the incoming 

40 connection to a current terminal format required by the current terminal if the current terminal format is different 

from the transmission format, and for performing a transmit type conversion on signals to be sent through the 
incoming connection from the current terminal format to the transmission format if the current terminal format is 
different from the transmission format.. 

45 14. A system as claimed in any preceding claim, further comprising an interface to a Unified Messaging System or 
personal agent service. 
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Fig. 5b 
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Fig. 5c 
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Fig. 5d 
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